Remote sensing device, system and method utilizing smartphone hardware components

ABSTRACT

A remote sensing device, system and method is described. The remote sensing device includes an enclosure, a smartphone, and a separate microcontroller. The smartphone is disposed within the enclosure. The separate microcontroller is communicatively coupled to the smartphone. The separate microcontroller includes a power management module, a microcontroller processor, and a wireless sensor network. The power management module is electrically coupled to an auxiliary battery that powers the smartphone. The separate microcontroller is communicatively coupled to smartphone and the separate microcontroller controls the power management module. The wireless sensor network includes a wireless communication interface that is different from the smartphone wireless communication interface. The remote sensing system includes a remote sensing component, a network module such as a web application server, and a database.

CROSS REFERENCE

This patent application is a continuation of U.S. Ser. No. 14/298,771filed on Jun. 6, 2014, entitled REMOTE SENSING DEVICE, SYSTEM AND METHODUTILIZING SMARTPHONE HARDWARE COMPONENTS, which claims the benefit ofprovisional patent application 61/896,573 filed on Oct. 28, 2013 andentitled REMOTE SENSING SYSTEM UTILIZING A SMARTPHONE, which is herebyincorporated by reference in its entirety.

FIELD

The claims presented herein are related to a remote sensing device,system, and method. More particularly, the claims presented herein arerelated to a remote sensing device, system and method that utilize aplurality of smartphone hardware components.

BACKGROUND

A wide range of business, scientific, law enforcement, manufacturing,and production applications require the ability to measure and collectdata and imagery in remote locations. This data supports specificoperational requirements such as site security and surveillance, openinggates, measuring water or electricity levels of temperatures, as well asmanagement reporting functions (trend information).

Remote sensing has the potential to be used in an even wider range ofsuch applications as the value of information becomes more valuable tomany industries and business areas. A limiting factor in unlocking thispotential is the cost and complexity of the systems and processesrequired to implement remote sensing capabilities and applications.Remote sensing applications can be in fixed positions or mobile.

Remote sensing applications are diverse and extensive. Some of theapplications include: water treatment, electrical power distribution andgeneration, oil and gas drilling and production, water management, motorracing, transportation, surveillance, military applications,environmental monitoring, scientific research, telemedicine, fishery andwildlife management and research, retail, law enforcement, energymanagement, testing, manufacturing, and facility and infrastructuremanagement (e.g., bridges, tunnels and healthcare).

There is also a need and value in having remote still and video data forsuch functions as situational awareness, surveillance and security,alarm verification, documentation, and troubleshooting at the remotelocation.

Traditional remote measurement and sensing applications involve analogsignals (e.g., thermistors to sense temperature) as well as digitalsignals (contact closures, relay outputs). Hardware for remotemonitoring systems is generally purpose-designed around an embeddedmicroprocessor, memory, modems, and IO. Modems and IO are often designedas modules in order to support configurations for differentapplications.

Most remote sensing applications have a requirement to operatestandalone; without outside power. This is often done by solar powerpanels, or, increasingly, various means of energy harvesting. Remotesensing systems must be able to operate 24 hours per day, seven days perweek when there is no sun, and in the case of power interruptions. Totalpower consumption then is a key design variable and contributessubstantially to size, cost, and installation efforts. Smartphoneplatforms are designed for extremely low standby power consumption—often1-2 orders of magnitude lower than traditional remote monitoringhardware.

Typical camera systems deployed for security or surveillance in outdoorsettings employ motion detectors to control alarming functions, as wellas the amount of video stored or transmitted. Such systems alsotypically employ illumination systems to enable image capture at night.Current state-of-the-art technology is a single node which integrates acamera, single or multi-sensor PIR for motion detection, and one or moreillumination elements. The fields of view of the camera, passiveinfrared receivers (PIR), and illumination elements are designed tocoincide.

There are a number of technologies for motion detection, with the mostcommon being passive infrared receivers. Costs of perimeter surveillancesystems are driven by the costs of the total number of cameras that mustbe deployed to cover a given area. In turn, the coverage capability of agiven motion detection and illumination camera system is typicallygoverned by the range capabilities of the motion detection andillumination components.

The overall coverage range of a given camera system has also beenlimited by the camera capabilities such as pixel count. As camera pixelcounts have improved dramatically, the design of more cost effectiveperimeter surveillance systems remains limited by the reach of themotion detection and illumination components.

An improved perimeter security and surveillance solution would includean ability to detect motion over a large area at low cost, an ability toprovide illumination for night imaging over a large area at low cost,and limited power requirements for both motion detection andillumination, in order to simplify cost of deployment and installation.

A system with these properties would provide a significant improvementin the price/performance capabilities of perimeter security systems byreducing the total number of cameras required to cover a given area ofinterest. The low power and wireless aspects provide additionalimprovements by lowering the total system cost by simplifyinginstallation and maintenance of the system.

SUMMARY

A remote sensing device, system and method is described. The remotesensing device includes an enclosure, a smartphone disposed within theenclosure, and a separate microcontroller. The illustrative smartphonemay be fixedly coupled to the enclosure. The smartphone includes asmartphone processor, a smartphone memory communicatively coupled to theprocessor, a smartphone camera communicatively coupled to the smartphoneprocessor and the smartphone memory, a smartphone wireless communicationinterface that communicates with a wide area network. A smartphonebattery is electrically coupled to the smartphone processor, thesmartphone memory, the smartphone camera, the first smartphonecommunication interface, and the second smartphone communicationinterface.

The illustrative microcontroller is communicatively coupled to thesmartphone. The microcontroller includes a power management module and amicrocontroller processor. The illustrative power management module iselectrically coupled to an auxiliary battery that powers the smartphoneand microcontroller processor. The illustrative microcontrollerprocessor is communicatively coupled to smartphone and themicrocontroller controls the power management module.

In one illustrative embodiment, the remote sensing device furthercomprises a temperature sensor within the enclosure, a cooling componentwithin the enclosure for cooling the smartphone housed by the enclosurewhen the temperature rises above a first threshold temperature that ismeasured by the temperature sensor, and a heating component within theenclosure for heating the smartphone housed by the enclosure when thetemperature falls below a second threshold temperature that is measuredby the temperature sensor. The enclosure may seal the smartphone and theseparate microcontroller to protect the smartphone and separatemicrocontroller from environmental conditions.

The remote sensing device may further comprise at least one solar panelcoupled to the auxiliary battery, where the solar panel may charge theauxiliary battery. The remote sensing device may further comprise atleast one sensor communicatively coupled to the smartphone thatcommunicates a sensor signal output and a corresponding timestamp to awide area network.

In certain embodiments, the separate microcontroller may furthercomprise a wireless sensor network module, and a sensor that furtherincludes a sensor wireless communication module that is communicativelycoupled to the wireless sensor network module. The remote sensing devicemay further comprise a motion detection sensor, and an illumination nodethat signals when motion is detected and then triggers a camera includedin the smartphone to capture at least one image. The remote sensingdevice may further comprise a separate camera communicatively coupled tothe smartphone.

A remote sensing system is also described that includes the remotesensing component described above, a web application server, and adatabase. The web application server is communicatively coupled to thewide area network and receives the sensor signal output andcorresponding timestamp from the smartphone. The database iscommunicatively coupled to the web application server and logs thesensor signal output and timestamp communicated by the smartphone.

Another illustrative remote sensing system is also described that doesnot include the separate microcontroller module described above. Theother illustrative remote sensing system includes an enclosure, asmartphone, and at least one sensor. The smartphone that is coupled tothe enclosure includes a smartphone processor, a smartphone memorycommunicatively coupled to the processor; a smartphone cameracommunicatively coupled to the smartphone processor and the smartphonememory, a first smartphone wireless communication interface thatcommunicates with a wide area network, and a smartphone batteryelectrically coupled to the smartphone processor, the smartphone memory,the smartphone camera and the first smartphone communication interface.The smartphone camera captures at least one image and the smartphonegenerates a corresponding timestamp. The image and the timestamp arethen communicated to the wide area network.

In a further illustrative embodiment the remote sensing system alsoincludes a network module and a database. The network module iscommunicatively coupled to the wide area network, wherein the networkmodule receives the sensor signal output and corresponding timestampfrom the smartphone. The database is communicatively coupled to thenetwork module and the database logs the sensor signal output andtimestamp communicated by the smartphone.

A remote sensing method is also presented that includes coupling thesmartphone to an enclosure. The method then proceeds to capture at leastone image with the smartphone camera wherein the smartphone generates acorresponding timestamp. The image and the timestamp are thencommunicated to the wide area network. The method then proceeds toenable the network module that is communicatively coupled to the widearea network to receive the sensor signal output from the smartphonecamera and the corresponding timestamp. The method then logs the sensorsignal output and timestamp communicated by the smartphone in a databasethat is communicatively coupled to the network module.

DRAWINGS

FIG. 1A shows an illustrative remote sensing device and a remote sensingsystem.

FIG. 1B shows an alternative illustrative remote sensing device thatoperates in similar manner as the remote sensing device in FIG. 1A.

FIG. 2 shows a detailed view of another illustrative remote sensingdevice and the associated hardware components.

FIG. 3 shows the electrical components for an illustrative smartphone.

FIG. 4 shows a plurality of illustrative sensors that may be operativelycoupled to the smartphone, microcontroller, or any combination thereof.

FIG. 5 shows the illustrative software components for the remote sensingdevice and system.

FIG. 6 shows the combination of a remote sensing device and a sensorillumination node.

FIG. 7A shows a more detailed view of an illumination and detectionnode.

FIG. 7B shows a more detailed view of a remote illumination node.

FIG. 7C shoes a more detailed view of a remote detection node.

FIG. 7D shows a remote illumination and detection method.

FIGS. 8A and 8B show an illustrative autonomous method for managing andcontrolling the remote sensing devices.

FIG. 9A shows a perspective view of an illustrative enclosure.

FIG. 9B shows a top view of the illustrative enclosure.

FIG. 10 shows a screenshot of an illustrative dashboard that logs datafor the remote sensing system described above

DESCRIPTION

Persons of ordinary skill in the art will realize that the followingdescription is illustrative and not in any way limiting. Otherembodiments of the claimed subject matter will readily suggestthemselves to such skilled persons having the benefit of thisdisclosure. It shall be appreciated by those of ordinary skill in theart that the systems, methods, and apparatuses described hereinafter mayvary as to configuration and as to details. The systems may vary as todetails and particular embodiments that reside on the network side andthe elements that reside on the client side. Also, the methods may varyas to details, order of the actions, or other variations withoutdeparting from the illustrative methods disclosed here in. Additionally,the apparatuses may vary as to details such as size, configuration,mechanical elements, material properties, housings, and other suchparameters.

The illustrative remote sensing device presented herein includes anenclosure with a smartphone and a microcontroller. The illustrativesmartphone does not require hardware modification and supports softwaremodification on the smartphone. Additionally, the illustrativesmartphone housed by the enclosure presented herein is configured tointerface with a microcontroller or circuit that is electrically coupledto the smartphone and can wirelessly communicate with a plurality ofother remote sensors.

A remote sensing system that includes a network module such as anillustrative web application server is also described. In operation, thedata from the remote sensors is communicated to the web applicationserver via the microcontroller and the smartphone.

The microcontroller also communicates with a power management modulethat manages the power being fed from an auxiliary battery to thesmartphone. The power management module manages the charging of theauxiliary battery. The power management module enables the smartphone tobe powered with a sustainable, yet unreliable power source such as solaror wind power. Thus, the power management module can manage high powerand low power conditions.

Smartphones are distinguished by powerful processors to handle imagesand video in real time including digitization of camera inputs. Also,smartphones include built-in wireless interfaces such as Wi-Fi,Bluetooth, and 3G/4G mobile. Additionally, smartphones include extremelylow power consumption and various low power operation modes.Furthermore, smartphones include built-in high capacity batteries andcharging circuitry, and substantial memory including non-volatilestorage for large amounts of data. Further still, smartphones includemulti-tasking operating systems, including the ability to easily installand configure general purpose applications which can utilize phonehardware functions including communications. Further yet, smartphonesalso include multi-band cellular interfaces including efficient datatransmission and hardware integration including custom ASICS thatprovide small size, low cost, and low power consumption.

Wireless carriers have device requirements to support devices operatingon their network. If hardware modifications are made to a particularsmartphone, then the particular smartphone has to be recertified. In oneillustrative embodiment, there are no hardware changes that requirerecertification.

An auxiliary battery is also provided. The auxiliary battery iselectrically coupled to the power management module and the illustrativesolar panels. The solar panels charge the auxiliary battery, which thencharges the smartphone battery.

By way of example and not of limitation, a passive infrared (PIR) sensoror a remote thermal infrared (TIR) sensor is presented as an element ofthe overall system that can operate independently of the microcontrolleror smartphone presented herein. The illustrative remote PIR, TIR orcombination thereof is configured to interface with other camerasystems.

In operation, the illustrative remote sensing system provides aperimeter security and surveillance solution that has the ability todetect motion over a large area at low cost, an ability to provideillumination for night imaging over a large area at low cost, andlimited power requirements for both motion detection and illumination inorder to simplify cost of deployment and installation.

The illustrative system, method, and apparatuses presented hereinprovide a significant improvement in the price/performance capabilitiesof perimeter security systems by reducing the total number of camerasrequired to cover a given area of interest. The low power and wirelessaspects provide additional improvements by lowering the total systemcost by simplifying installation and maintenance of the system.Additionally, the modifications to achieve the autonomous operationpresented herein are not intended to be limiting or specific to theillustrative Android operating system. Other operating systems such asApple's iOS, Microsoft's Windows Phone, and other such smartphoneoperating systems may also be used.

Illustrative features of the remote sensing device, system, and methodinclude support for a solar powered camera, image processing includingimage motion detection so that video is only streamed when somethinghappens, and alarms only when intrusion is detected. Additionally, theremote sensing system enables a remote telemetry monitoring and controlsystem to estimate power and bandwidth consumption. Furthermore, theremote sensing system also supports thermal management over a diurnalcycle with an auxiliary battery and a clean energy source such as solaror wind.

Referring to FIG. 1A there is shown an illustrative remote sensingdevice 100 and a remote sensing system 102. The illustrative remotesensing device 100 includes an enclosure 104, a smartphone 106, at leastone sensor or actuator 108, and a microcontroller 110 having its ownmicroprocessor. The illustrative remote sensing device is also referredto as an “MNode” and these terms may be used interchangeably in thispatent. In the illustrative embodiment, the smartphone 106 is fixedlycoupled to the enclosure 104. The illustrative smartphone 106 furtherincludes a smartphone processor, a smartphone memory that iscommunicatively coupled to the smartphone processor, and a smartphonecamera communicatively coupled to the smartphone processor and thesmartphone memory. Further detail of the illustrative smartphone isprovided in FIG. 3 below.

In one illustrative embodiment, the microcontroller 110 includes a powermanagement module, a controller, and a wireless standard networkinterface. The illustrative microcontroller is electrically coupled to apower input 107, such as an auxiliary battery that is powered by a solarpanel. The illustrative microcontroller is also electrically coupled toan illustrative data or communications line 109. Further detail of thisillustrative embodiment is provided in FIG. 2 below.

Alternatively, the microcontroller may be more limited in itsfunctionality and simply provide an interface for an external powersupply and a battery charging circuit that is electrically coupled tothe smartphone 106, as described in FIG. 1B below.

By way of example and not of limitation, the illustrative sensor oractuator 108 includes a motion detection sensor 108 a that signals whenmotion is detected and then triggers the smartphone camera 111 tocapture at least one image. The illustrative motion sensor 108 a may bewithin the enclosure 104. In an alternative embodiment, the motionsensor 108 a may also be external to the enclosure and becommunicatively coupled to the microcontroller using the WSN, Wi-Fi,NFC, a hardwired connection such as USB or Ethernet, and any other suchcommunication methods or standards.

To allow imaging at night or during low light with the smartphone camera111 sensor, the illustrative remote sensing system may also include atleast one illumination node 112. Additionally, a plurality ofillumination nodes 114 may be utilized to further extend the viewingrange of the smartphone camera 111. The illumination nodes may bestrategically located within the physical premises. Additionally, theillumination may occur inside the enclosure.

In one illustrative embodiment, the illustrative sensor 108 includes adaylight sensor that indicates when it is dark and causes theillumination node 112 to illuminate a nearby area so the smartphonecamera can capture an illuminated image. Further detail of theillustrative illumination node is provided in FIGS. 5 and 6 presentedbelow.

In a further embodiment, the remote sensing device may also include asensor 108 b or 108 c that is separated from the enclosure. Theillustrative separate sensor 108 b includes a separate cameracommunicatively coupled to the smartphone 106 and a separate motiondetection sensor 108 c that signals when motion is detected and sends amessage using one of the smartphone communication interfaces to theseparate camera, which then captures at least one image. By way ofexample and not of limitation, the separate sensor 108 b may be disposedinside the enclosure 104.

In a still further embodiment, the sensor 108 within the remote sensingdevice may also include a temperature sensor 108 a. The temperaturesensor 108 a may be used to control a cooling component and a heatingcomponent that is described in further detail in FIG. 2 below.

The remote sensing device 100 is communicatively coupled to a networkedmodule 116, which includes by way of example and not of limitation anillustrative web application server 116. In one embodiment the webapplication server 116 a is disposed in a network cloud. In anotherembodiment the web application server 116 b is disposed on a premisesbased server. In certain embodiment, the network may be a hybrid thatincludes the premises based server 116 b and the cloud based server 116a.

The illustrative cloud based web application server 116 a and premisesbased web application server 116 b are both behind an illustrativehardware firewall 118 a and 118 b, respectively. Alternatively,communications with the web applications servers may be performed usinga virtual private network (VPN) that does not require a hardwarefirewall and operates as a “software” firewall. In one illustrativeembodiment, the network communications include wirelessly communicatingwith an illustrative base station 120 that is managed by a wirelesscarrier. Alternatively, communications with the remote sensing deviceinclude an illustrative Wi-Fi access point 122 that operates behind asoftware or hardware firewall 124, which is communicatively coupled to amodem 126 that, in turn, is communicatively coupled to the Internet.

The illustrative network module 116 includes a database that receivesthe sensor signal output and corresponding timestamp. The timestamp maybe generated by the sensor, the smartphone, or other network device inthe communications path between the sensor or actuator 108 or smartphone106 and the network module 116. In another illustrative embodiment, thedatabase is communicatively coupled to the networked module and logs thesensor signal output and timestamp communicated by the smartphone 106 orsensor 108.

By way of example and not of limitation, the illustrative network modulefor the remote sensing system includes a web application server thatfurther includes the database. Additionally, the smartphone of theremote sensing system further includes a smartphone application thatconfigures the smartphone to interface with the illustrativemicrocontroller 110. In alternative embodiment, the smartphone includesat least one Application Programming Interface (API) that receives thesensor signal output, and the API communicates the sensor signal outputreceived by the smartphone to the database associated with the webapplication server.

In yet another embodiment, a power input 107 interfaces with input powergathered from an external source such as mains, solar panel, energyharvesting circuits, and other such power sources. One or more actuators108 may be connected to the remote sensing device via wired or wirelessinterfaces, such as Ethernet, serial, Wi-Fi, Bluetooth, 802.15.4,Zigbee, or other low-power wireless sensing network interface. Theremote sensing device 100 communicates with sensors to read sensedvalues, as well sensor configuration data. The remote sensing device 100communicates with actuators to set output values. An illustrative USB109 communications port, such as USB2, allows the remote sensing device100 to receive user inputs and provide user feedback.

Referring to FIG. 1B there is shown an alternative illustrative remotesensing device 130 that operates in similar manner as the remote sensingdevice 100, except without the microcontroller 110. The remote sensingdevice 130 includes an enclosure 132, a smartphone 134, and at least onesensor or actuator 136. As described herein, the smartphone is fixedlycoupled to the enclosure and includes a smartphone processor, asmartphone memory, smartphone battery, and a smartphone cameracommunicatively coupled to the smartphone processor and the smartphonememory.

In one illustrative embodiment, the smartphone camera 133 operates as aninternal sensor that captures at least one image. The smartphone 134generates a corresponding timestamp. The image and timestamp are thencommunicated to wide area network.

In another illustrative embodiment, the sensor 136 a is housed withinthe enclosure 132, and the sensor 136 a is electrically coupled andcommunicatively coupled to the smartphone 134 via the second smartphonenetwork interface. Alternatively, the sensor or actuator 136 may includean external sensor 136 b that housed outside in the enclosure 132 and isseparately powered, yet communicatively coupled to the smartphone 134.

In operation, at least one of the sensors 133, 136 a, or 136 b detectsat least one sensor signal output and communicates the sensor signaloutput to the smartphone 134, which then communicates the sensor signaloutput and a corresponding timestamp to the wide area network. Aspresented above, the remote sensing device 130 is communicativelycoupled to a networked module, which includes by way of example and notof limitation an illustrative web application server 116. In oneembodiment the web application server 116 a is disposed in a networkcloud and in another embodiment the web application server 116 b isdisposed on a premises-based server. The illustrative cloud based webapplication server 116 a and premises-based web application server 116 bare both behind an illustrative hardware firewall 118 a and 118 b,respectively. Alternatively, communications with the web applicationsservers may be performed using a virtual private network (VPN) that doesnot require a hardware firewall and operates as a “software” firewall.

The illustrative web application server 116 may also be embodied as oneof four fundamental cloud service models, namely, infrastructure as aservice (IaaS), platform as a service (PaaS), software as a service(SaaS), and network as a service (NaaS). The cloud service models aredeployed using different types of cloud deployments that include apublic cloud, a community cloud, a hybrid cloud, and a private cloud.

Infrastructure as a service (IaaS) is the most basic cloud servicemodel. IaaS providers offer virtual machines and other resources. Thevirtual machines, also referred to as instances, are run as guests by ahypervisor. Groups of hypervisors within the cloud operational supportsystem support large numbers of virtual machines and the ability toscale services up and down according to customers' varying requirements.IaaS clouds often offer additional resources such as images in a virtualmachine image library, raw (block) and file-based storage, firewalls,load balancers, IP addresses, virtual local area networks (VLANs), andsoftware bundles. IaaS cloud providers supply these resources on demandfrom their large pools installed in data centers. For wide areaconnectivity, the Internet can be used or virtual private networks(VPNs) can be used.

Platform as a service (PaaS) enables cloud providers to deliver acomputing platform that may include an operating system, a programminglanguage execution environment, a database, and a web server.Application developers can develop and run their software solutions onthe PaaS without the cost and complexity of buying and managing theunderlying hardware and software layers. With some PaaS solutions, thesystem resources scale automatically to match application demand so thatthe cloud end user does not have to allocate resources manually.

Software as a service (SaaS) enables cloud providers to install andoperate application software in the cloud. Cloud end users access thesoftware from cloud clients. The cloud end users do not manage the cloudinfrastructure and platform that run the application. The SaaSapplication is different from other applications because of scalability.Scalability can be achieved by cloning tasks onto multiple virtualmachines at run-time to meet the changing work demand. Load balancers inthe SaaS application distribute work over a set of virtual machines. Toaccommodate a large number of cloud end users, cloud applications may bemultitenant and serve more than one cloud end user organization. SomeSaaS solutions may be referred to as desktop as a service, businessprocess as a service, test environment as a service, communication as aservice, etc.

The fourth category of cloud services is Network as a service (NaaS), inwhich the capability provided to the cloud service end user is to use anetwork/transport connectivity services, an inter-cloud networkconnectivity services, or the combination of both. NaaS involves theoptimization of resource allocations by considering network andcomputing resources as a unified whole, and traditional NaaS serviceswhich include flexible and extended VPN and bandwidth on demand.

In addition to the smartphone 100 and smartphone 130, other “cloud”clients may access the networked module 116. These client devicesinclude, but are not limited to, desktop computers, laptops, tablets,and other smartphones. Some of these cloud clients rely on cloudcomputing for all or a majority of their applications, and would beessentially useless without it. Many cloud applications do not requirespecific software on the client device and instead use a web browser tointeract with the cloud application.

There are different types of cloud deployment models for the cloud-basedservice, which include a public cloud, a community cloud, a hybridcloud, and a private cloud. In a public cloud, applications, storage,and other resources are made available to the general public by aservice provider. These services are free or offered on a pay-per-usemodel.

The community cloud infrastructure is between several organizations froma community with common concerns, whether managed internally or by athird-party and hosted internally or externally; so the costs are spreadover fewer users than a public cloud (but more than a private cloud).

The private cloud infrastructure is operated solely for a singleorganization, whether managed internally or by a third-party and hostedinternally or externally. A private cloud project requires virtualizingthe business environment, and it requires that the organizationreevaluate decisions about existing resources.

The hybrid cloud is a composition of two or more clouds (private,community, or public) that remain unique entities but are boundtogether, offering the benefits of multiple deployment models. Hybridcloud architecture requires both on-premises resources and off-site(remote) server-based cloud infrastructure. Although hybrid clouds lackthe flexibility, security, and certainty of in-house applications, ahybrid cloud provides the flexibility of in-house applications with thefault tolerance and scalability of cloud-based services.

The illustrative network module 116 may operate in any of the cloudservice or cloud infrastructure models presented herein or which mayreadily suggest themselves to those of ordinary skill in the art havingthe benefit of this patent. The three primary software applications forthe remote sensing system 102 include the smartphone 106 softwaremodule, the illustrative web application server 116 software module, themicrocontroller 110 firmware module, and firmware running in any of theremote sensors or actuators.

The illustrative smartphone 106 software module includes a localsoftware module configured to be executed on the smartphone 106. By wayof example and not of limitation, a smartphone using the Androidoperating system is configured to run a software application thatcommunicates with the illustrative web application server 116 softwaremodule.

The illustrative smartphone 106 software module is also configured toreceive configuration parameters from the web application server 116,which control the operation of the remote sensing device 100 or 130.These configuration parameters allow programming the remote sensingdevice 100 or 130 to schedule when logged data in the remote sensingdevice 100 or 130 software module is uploaded to the management node forarchival and/or viewing. The control parameters also include thefrequency the smartphone 106 software module should contact theillustrative web application server 116 that is configured to retrieveany pending commands. The control parameters also include “events” or aschedule that cause an image, a video, or an analog or digital input tobe captured by the remote sensing device 100 or 130. An illustrativeanalog or digital input includes a Passive Infrared (PIR) motiondetection input. Another control parameter includes conditions to testfor generating alarms, such as an alarm caused by PIR triggering. Yetanother control parameter includes sending a destination and at leastone message for each condition that occurs.

The illustrative web application server 116 software module includes aweb-based application that executes in the cloud and communicates withall registered remote sensing devices 100 or 130. The illustrative webapplication server 116 software module is also configured to archivedata from the remote sensing devices 100 or 130 and provide end userswith a graphical interface for interacting with the remote sensingdevices.

As described herein, the illustrative web application server 116 mayreside in the cloud and include a mirror of collected data, controls forsetting configuration and managing multiple remote devices, controls todeal with billing based on device, controls for billing data access,network usage, controls to deal with end sensor device networkmanagement include sensor device registration, and automating deviceconfiguration such as carrier based service limits. In yet anotherillustrative embodiment, the illustrative web application server 116 mayalso operate as a distributed system.

The illustrative microcontroller 110 firmware module performs powermanagement supervision, alarming, wireless sensor node management, andmanages environmental controls that provide heating and/or cooling. Theillustrative microcontroller 110 firmware module communicates with thesmartphone 106 software module via USB. In an alternate embodiment, theillustrative microcontroller 110 firmware module is configured tocommunicate with the smartphone 106 software module with a wirelesscommunication protocol such as Wi-Fi, NFC, or Bluetooth.

Referring to FIG. 2, there is shown a detailed view of anotherillustrative remote sensing device 200 and the associated hardwarecomponents. An illustrative smartphone 202 executes the smartphone 106software module and performs remote sensing, alarming, and dataarchival. The illustrative remote sensing device 200 comprises amicrocontroller 204 that further includes a power management module 206,a controller 208, a wireless sensor network (WSN) interface 210, atemperature sensor 212 such as a thermistor operatively coupled to themicrocontroller, a cooler element 216, and a heater element 214 that arealso communicatively coupled to the microcontroller 204. Themicrocontroller 204 includes a wireless sensor network (WSN) 210interface that can operate with additional wireless standards that arenot supported by the smartphone 202.

The controller 208 includes a microcontroller firmware module 209, whichmanages and controls power management processes including reportingbattery level, alarming devices at threshold levels, and communicatingwith wireless sensor nodes using the wireless sensor network 210.Specific input events received by the controller 208 notify thesmartphone to perform a particular operation. For example, themicrocontroller firmware module 209 may be triggered to take a picturewhen a motion detector fires. In another illustrative example, themicrocontroller firmware module 209 may be triggered to maintain thetemperature within the enclosure 220 within a required temperature rangethat keeps the smartphone 202 working properly.

Additionally, the illustrative microcontroller firmware 209 includescode that executes on the controller 208 and performs power managementsupervision, alarming, wireless sensor node management, andenvironmental controls operations such as heating and cooling. In theillustrative embodiment, the microcontroller firmware module 209communicates with the smartphone software module 211 via USB. In analternative embodiment, the microcontroller firmware module 209communicates with the smartphone software module 211 via a wirelessinterface such as NFC, Bluetooth, or Wi-Fi.

Additionally, the WSN interface 210 is configured to interface with oneor more remote sensors or other such Input/Output devices that cancommunicate using the WSN interface 210. This allows remote inputs to beread by the remote sensing device 200.

In operation, the illustrative power management module 206 providesinput power conditioning of the external power input and batterycharging circuitry, feeding both the internal smartphone battery and theauxiliary battery 218 with a charge signal. The controller 208communicates with the power management module 206 and is configured toturn the smartphone 202 on or off.

An enclosure 220 houses the smartphone 202, electronic circuit 204,temperature sensor 212, cooler 216, and heater 214. This enclosure 202seals these components from the environment and provides an appropriatethermal environment which can be temperature controlled to maintaininternal temperatures within allowable range in the face of ambienttemperature fluctuations. In the illustrative embodiment, the enclosure220 is fabricated from materials that do not attenuate RF signals in thebands used by cellular, Wi-Fi, Bluetooth, NFC, and wireless sensornetworks.

In the illustrative embodiment, the microcontroller 204 connects to thesmartphone with a USB connection. In the illustrative embodiment, theADB protocol is used with the USB connection in order to allow themicrocontroller 204 to communicate with the smartphone 202 in a flexiblefashion. Other protocols for communicating over a USB serial link oralternative wireless link embodiment may also be employed.

The smartphone software module 211 executing on the smartphone 202 isconfigured to communicate with the microcontroller 204 over USB, therebyallowing the phone 202 to have access to power management functions, aswell as nodes attached to the WSN. Other modes and protocols forcommunication between the microcontroller 204 and the smartphone 202will be apparent to one skilled in the art.

In certain embodiments, the smartphone 202 may be fitted with anoptional external lens to provide narrower field of view or dynamic zoomcapabilities. Additionally, the remote sensing device 200 may include anelectro-mechanical mechanism that enables the remote sensing device topoint itself (and correspondingly, the camera field of view) within alarger overall field of regard using a pan-tilt mechanism. This pan-tiltmechanism may be controlled by the remote sensing device 200 based onlocally-executing logic, or based on events detected by the attached WSNnodes, or based on remote user inputs.

The cooling component 216 within the enclosure 220 cools the smartphoneand the sensors housed by the enclosure when the temperature rises abovea first threshold temperature that is measured by the temperaturesensor. The heating component within the enclosure heats the smartphoneand/or the sensors and/or the batteries housed by the enclosure when thetemperature falls below a second threshold temperature that is measuredby the temperature sensor.

In operation, the controller 208 communicates control signals to thesmartphone 202. The controller 208 controls the power management module206 and decides whether to feed power to the smartphone or not. Thus,the controller optimizes power management by enabling the smartphone toenter and exit a sleep mode. In one illustrative embodiment, thesmartphone software module 211 includes a power logic module and themicrocontroller 204 includes a separate power logic module, in which themicrocontroller 204 may decide to put the smartphone in sleep mode. Thecontroller 204 also regulates the internal temperature of the enclosureso that the phone does not overheat or get too cold.

The power management module 206 performs battery charging operations andstate of charge measurements for the auxiliary battery 218 and for thesmartphone 202. The power management module 206 includes a batterycharging circuit that charges the auxiliary battery 218. The powermanagement module includes a high power mode and a low power mode. Thecontroller also manages the power being fed from the auxiliary battery218 to the smartphone 202. The power management module 206 manages thecharging of the auxiliary battery 218. The power management module 206enables the smartphone to be powered with a sustainable, yet unreliablepower source such as solar or wind power. Thus, the power managementmodule can manage high power and low power conditions.

The operations of the microcontroller 204 may also be performed by thesmartphone processor, smartphone memory, and smartphone wirelesstransceivers communicatively to the local sensors. In that case, theillustrative smartphone would have to be powered with a typical 5V powerconnection. Current smartphones support Wi-Fi, Bluetooth and NFC and canuse these wireless communication standards to communicate with othersensors. The smartphone may be powered with solar panel adapters thatprovide the required 5V charging power for a smartphone.

Referring to FIG. 3, there is shown the electrical components for anillustrative smartphone 300. For purposes of this patent, theillustrative smartphone 300 is a multimode wireless device thatcomprises a first antenna element 302 that is operatively coupled to aduplexer 304, which is operatively coupled to a multimode transmittermodule 306, and a multimode receiver module 308.

An illustrative control module 318 comprises a digital signal processor(DSP) 312, a processor 314, and a CODEC 316. The control module 318 iscommunicatively coupled to the transmitter 306 and receiver 308. Thetransmitter module and receiver module are typically paired and may beembodied as a transceiver. The illustrative transmitter 306, receiver308, or transceiver is communicatively coupled to antenna element 302.

The DSP 312 may be configured to perform a variety of operations such ascontrolling the antenna 302, the multimode transmitter module 306, andthe multimode receiver module 308. The processor 314 is operativelycoupled to a sensor 320, such as a camera. In operation, the camerasensor 320 is configured to be managed and controlled by the smartphoneprocessor.

The processor 314 is also operatively coupled to a memory 322, a display324, and a charging circuit 326. The charging circuit is operativelycoupled to a smartphone battery 328.

Additionally, the processor 314 is also operatively coupled to the CODECmodule 316 that performs the encoding and decoding operations and iscommunicatively coupled to a microphone 330 and a speaker 332. The CODECmodule 316 is also communicatively coupled to the display 324 andprovides the encoding and decoding operations of captured video.

The memory 322 includes two different types of memory, namely, volatilememory 323 and non-volatile memory 325. The volatile memory 323 iscomputer memory that requires power to maintain the stored information,such as random access memory (RAM). The non-volatile memory 325 canretain stored information even when the wireless communication device300 is not powered up. Some illustrative examples of non-volatile memory325 include flash memory, ROM memory, and hard drive memory.

Smartphone 300 may also be referred to as a mobile handset, mobilephone, wireless phone, portable cell phone, cellular phone, portablephone, a personal digital assistant (PDA), a tablet, a portable mediadevice, a wearable computer, or any type of mobile terminal which isregularly carried by an end user and has all the elements necessary foroperation in the remote sensing system. The wireless communicationsinclude, by way of example and not of limitation, 3G, 4G, LTE, CDMA,WCDMA, GSM, UMTS, or any other wireless communication system such aswireless local area network (WLAN), Wi-Fi or WiMAX. Additionally, thesmartphone 300 may also be connected via USB (or via theMicrocontroller) to an external Satellite modem in order to provide analternative to Mobile or Wi-Fi for WAN connection.

Referring to FIG. 4, there is shown a plurality of illustrative sensors400 that may be operatively coupled to the smartphone, microcontroller,or combination thereof. The sensors include an RGB camera 402 that maybe used to capture images, videos, or any combination thereof. Anothersensor includes an infrared (IR) camera 404 the may be used to captureIR images, IR videos, or any combination thereof. A proximity sensor 406may be used to detect a person entering a particular location, and theproximity sensor 406 may operate using an IR sensor. An ambient lightsensor 408 or photo sensor detects changes in light, and the changes inlight may be generally associated with a responsive input. A temperaturesensor 410 detects the temperature, which may be generally associatedwith a responsive input. A pressure sensor 412 detects the pressure andis generally associated with a responsive input, e.g. change in pressuremay indicate change in weather. A GPS or location sensor 414 may also beused to determine or provide the location of smartphone, microcontrolleror any combination thereof. Also, a microphone 416 may be utilized as asound sensor. Additionally, auxiliary sensors for connecting tosmartphones are known in the art; these illustrative sensors take theform of a “sled” or phone “case” that incorporates a sensor that is notavailable inside the smartphone, e.g. a thermal camera. Such asmartphone “peripheral” can easily be incorporated and provide anadditional sensor in the system.

FIG. 5 shows the illustrative software components for the remote sensingdevice and system described herein. The illustrative software components211 are configured to be executed within the standard operating systemframework on the smartphone hardware described above. In theillustrative embodiment, at least one the software components 211 isconfigured to communicate with the microcontroller described herein.Typical operating system services and resources are available to thesoftware modules and enable them to execute functions as required, andto access system resources such as the camera and non-volatile memory.

The first component of the software architecture includes the remoteapplication interface module 502 which manages the interaction with theremote user and any remote management application. More specifically,the remote application interface module 502 is configured to communicatewith the illustrative WebApp Server 116 (shown in FIG. 1). The remoteapplication interface module 502 processes commands for changing theconfiguration data 504, retrieves the collected data 506, and receivesimmediate readings from attached sensors or the camera. The illustrativeremote application interface is also responsible for sending any alarmsor notifications generated by event and data manager 508.

The illustrative collected data component 506 includes an illustrativedatabase store of data acquired from the camera and/or any attachedsensors collected by the configuration data 504 specification.

The illustrative configuration data component 504 includes parametersthat relate to the configuration of the remote sensing system, includingconfigurable aspects of data collection. By way of example and not oflimitation, data collection parameters include specification of theconditions upon which to begin and end data collection for each point,the frequency of sampling, etc. These conditions may have programmaticmeaning because they are based on values of other sampled data. Forexample, the camera can be trigged to store an image or a video clipwhen an attached motion detector is activated.

The illustrative configuration data component 504 also includes aspecification for events and notifications based in measured values fromattached sensors and camera(s). By way of example and not of limitation,an alarm can be set such that if an attached temperature sensor readsabove a certain value, then an email, text message, or phone call ismade to the specified addresses.

In the illustrative embodiment, a sensor network management module 510is configured to communicate with any sensors attached to orcommunicatively coupled to the remote sensing system.

An illustrative event and data manager 508 module is configured toensure data is collected according to configuration data component 504.Additionally, the event data manager 508 is further configured togenerate alarms and notifications according to configuration datacomponent 504. The event and data manager 508 also provides analytics.The event data manager 508 includes logic to detect events based oncollected data. For example, one illustrative embodiment is a videomotion detection function that utilizes video or images from the camerato determine if there is motion present in the scene. Such motion wouldresult in a motion detection event, which may then be communicated orused to trigger other events or actions.”

In the illustrative embodiment, the integrated camera 512 may beconnected to an optional lens that is integral with the enclosure andthe camera/enclosure mounting system. The illustrative camera 512 can beaccessed from the smartphone operating system in order to capture stillimages or video clips. Depending on the smartphone used, the camera mayalso include flash or other auxiliary mechanism to enhance image qualityunder various conditions.

In an alternative embodiment, an optional second camera communicateswith the smartphone via Wi-Fi or other short-range wireless technologysupported by the smartphone (NFC, Bluetooth, etc.) The smartphonecontrols the auxiliary camera to configure, capture images/video, etc.as if the auxiliary camera were built into the smartphone. Images fromthe external camera are transferred over the wireless interface to thesmartphone and then are treated as if they were captured from thesmartphone's internal camera.

The illustrative camera management module 514 manages the integrated andoptional auxiliary cameras to capture still or video imagery based oncommands from the event and data manager 508, and then stores thosecaptured images in the collected data 506.

The smartphone software components 211 are configured to operate at verylow power. All programmed events (such as timed data logging andschedules for upload of data) are analyzed, and the smartphone softwareapplication utilizes operating system features to place the phone intolow power mode. Low power mode is exited when either the timer hasexpired, or a message has arrived from the microcontroller over USB,indicating an urgent 10 event has occurred.

In one illustrative embodiment, an algorithm operating on themicrocontroller reads the thermistor and controls the heater and coolerto maintain internal temperature within operating range of thesmartphone.

FIG. 6 shows the combination of a remote sensing device and a sensorillumination node, which may be used as a perimeter security system. Theillustrative remote sensing device 602 includes one of the remotesensing devices presented above and the corresponding hardware andsoftware architecture.

In FIG. 6, the illustrative remote sensing device 602 includes a camerahaving a field of view 604. During the day, the sunlight provides enoughlight to fully illuminate the field of view of the camera of the remotesensing device 602.

However, at night, a single light source is unable to illuminate theentire field of view 604. To better illuminate the entire field of view604, a plurality of sensor illumination nodes 606 are used. Each sensorillumination node 606 includes a sensor and an illuminator that providesa sensor illumination field of view 608. For example, the sensorillumination nodes 606 a, 606 b, 606 c, 606 d and 606 e have acorresponding sensor illumination field of view 608 a, 608 b, 608 c, 608d and 608 e, respectively.

In operation, each sensor illumination node 606 senses motion or otherevents of interest in the vicinity of that particular sensorillumination node 606. When the sensor illumination node 606 detects anevent, the particular sensor illumination node 606 sends a message tothe remote sensing device 602 using the illustrative wireless sensornetwork. The remote sensing device may then instruct the particularsensor illumination node 606 to turn on the illumination so that imagerycan be captured at night or with increased fidelity. The sensorillumination nodes 606 are closer to the event or subject of interestthan just a remote sensing device. As a result, a larger area can becovered by the wirelessly networked sensor nodes, in spite of sensingrange limitations and illumination range limitations associated with thesensor illumination nodes 606.

Referring to FIGS. 7A, 7B and 7C there is shown a remote illuminationand detection node, a remote illumination node, and a remote detectionnode, respectively. More generally, a remote illumination and detectionmethod 730 is also shown in FIG. 7D.

The illustrative remote illumination and detection method 730 isinitiated at block 732 where a detector generates a detection messagewhen motion is detected by the detector. The illustrative detectorincludes a first wireless communications module that wirelesslytransmits the detection message to a remote sensing device as describedin block 734.

At block 736, the remote sensing device then proceeds to generate anillumination instruction to illuminate an area within the field of view,when the remote sensing device receives the detection message. Theillustrative remote sensing device includes a camera having a field ofview and a second wireless communications module that communicates withthe first wireless communications module associated with the detector.The first wireless communications module and the second wirelesscommunications module use the same wireless communication protocol.

The method then proceeds to block 738 where the remote sensing devicetransmits the illumination instruction to an illuminator. Theilluminator is communicatively coupled to a third wirelesscommunications module that is communicatively coupled to the secondcommunication module associated with the remote sensing device.

At block 740, an area near the illuminator is illuminated, when motionis detected by the detector and the illumination instruction is receivedby the illuminator.

Referring now to FIG. 7A, there is shown an illustrative illuminationand detection node 607 a that is communicatively coupled to the remotesensing device 720 a. The illumination and detection node 607 aembodiment includes a motion or event detector 702 a and an illuminator708 a that share the same housing, a microprocessor 704 a, and networkinterface module 706 a. The illustrative illumination and detection node607 a share a network interface module that includes at least onewireless communication module that operates using a wirelesscommunication protocol such as WSN, Wi-Fi, Bluetooth, NFC, and othersuch wireless communications standards.

In operation, the detector 702 a generates the detection message whenmotion is detected. The detection message is wirelessly communicatedfrom the illumination and detection node 607 a to the remote sensingdevice 720 a. The remote sensing device 720 a may then proceed togenerate an illumination instruction, which is then communicated to theillumination and detection node 607 a. The area near the illuminator 708a is illuminated when the illumination instruction communicated by theremote sensing device 720 a is received by the illumination anddetection node 607 a. The illuminator may remain on until anotherillumination instruction is received that instructs the illuminator toturn off. The illumination and detection node 607 a includes a battery714 a electrically coupled to a charge circuit 712 a that iselectrically coupled to a solar panel 710 a. Alternatively, power may beprovided from other energy sources such as a gasoline or dieselgenerator, the electrical grid, wind energy and other such energysources.

Referring to FIG. 7B, there is shown an illustrative remote illuminationsystem that includes an illumination node 607 b communicatively coupledto a remote sensing device 720 b, which in turn is communicativelycoupled to a remote detector 722. An illuminator 702 b is housed withinthe remote illuminator node 607 b that illuminates the area near theilluminator 702 b. The illumination node 702 b is communicativelycoupled to remote sensing device 720 b which is communicatively coupledto remote detector 722. When the remote detector 722 detects motion, adetection message is generated that is communicated to the remotesensing device 720 b using a wireless communication protocol. The remotesensing device includes a camera having a field of view and a remotesensing wireless communications module that receives the detectionmessage from the remote detector. The remote sensing device thendetermines whether to generate an illumination message. For example, theillumination message may be generated when it is dark or there is apower outage or other such event that would require illuminating thearea near the illuminator and within the field of view of the remotesensing device 720 b camera.

The remote illumination node 607 b includes a remote illuminationhousing, a wireless network interface module 706 b, a processor 704 b,the illuminator 702 b, and a battery 714 b electrically coupled to acharge circuit 712 b. In the illustrative embodiment the charge circuit712 b is electrically coupled to a solar panel 710 b. The wirelessnetwork interface module 706 b is communicatively coupled to the remotesensing device 720 b. The processor 704 b receives the illuminationinstruction to illuminate a nearby area when motion is detected by theremote detector 722. The illuminator 702 b is operatively coupled to theprocessor and illuminates a nearby area when the illuminator 702 breceives the illumination instruction. The illuminator may remain onuntil another illumination instruction is received that instructs theilluminator to turn off. The battery 714 b powers the illuminator 702 b,the processor 704 b and the wireless network interface module 706 b.

Referring to FIG. 7C, there is shown a remote detection node 607 ccommunicatively coupled to remote sensing device 720 c, whichcommunicates with remote illuminator 724. The remote detection node 607c houses a motion or event detector 702 c that detects motion in thefield of view of the remote sensing device 720 c. When motion isdetected by the remote detection node 607 c, a detection message isgenerated and communicated to the remote sensing device 720 c. The areanear the illuminator 724 is illuminated when the detection messagegenerated by the remote detection node 607 c is received by the remotesensing device 720 c, and the remote sensing device 720 c determinesthat an illumination instruction must be generated and communicated tothe remote illuminator node 724. The illuminator may remain on untilanother illumination instruction is received that instructs theilluminator to turn off.

The remote detection node 607 c includes a housing, a wireless networkinterface module 706 c communicatively coupled to the remote sensingdevice 720 c, a detector 702 c, a processor 704 c and a battery 714 c.The battery 714 c is electrically coupled to a charge circuit 712 c,which is electrically coupled to a solar panel 710 c. The motion orevent detector 702 c is operatively coupled to the processor 704 c anddetects motion in the field of view of the camera corresponding to theremote sensing device 720 c. The detector 702 c generates a detectionmessage, when motion is detected. The detection message is communicatedwirelessly to the remote sensing device 720 c. The battery powers thedetector, the processor and the wireless network interface module.

By way of example and not of limitation, the illuminator 708 a, 702 band 724 may include a low power infrared or visible LED or laser output.Additionally, the illustrative detector 702 a, 722, and 702 c mayinclude an infrared detector, RF-based motion sensor, a vibration-basedmotion sensor, a light-beam based presence sensor, or an optically-basedmotion detection module (e.g. camera that includes image processing).

In operation, a person walking across the detection field of theillustrative motion or event detector 702 a, 722 and 702 c would bedetected. When it is dark, the illustrative remote sensing devices 720a, 720 b and 720 c sends a signal to the illuminator 708 a, 702 b, and724, respectively, to illuminate a nearby area. The signal to theilluminator may be sent after a specific delay time that models the timerequired for the illumination instruction generated by the remotesensing device to be sent, received, and acted upon. The illuminator 708a, 702 b, and 724 then illuminates the scene for a particular period oftime that allows the remote sensing device 720 a, 720 b and 720 c,respectively, to complete its image acquisition.

In another embodiment, a day/night sensor automatically turns on theilluminator when motion is detected at night time, and then sends amessage to the remote sensing device. In yet another embodiment, thedetector 702 a, 722 and 702 c includes an infrared detector having a lowpower design system that is excited by incoming infrared energy. Themicroprocessor and network interface module execute a low-power sleepmode until a motion detection event. A hardware interrupt mechanism maybe used to wake the microprocessor and network interface module from thesleep modes.

The motion or event detector 702 a, 722 and 702 c may be based on othertechnologies such as a laser-based “trip-line,” vibration sensors, RFbased motion sensors, optically-based motion sensors or sound sensors.Each of these types of sensors is aimed at detecting an event ofinterest that is to trigger further sensing by way of illuminatedimaging.

The illustrative illuminator 708 a, 702 b, and 724 utilizes an infraredLED or other modern, low-power illumination technology that generatesthe necessary light output. The LED or laser-based illumination mayoperate in visible or infrared bands depending on the imagingapplication. The microcontroller 704 manages activation of theillumination so that power consumption is minimized. The techniques forminimizing power consumption include minimizing duty cycle by both thetotal time the illumination is on, and by using PWM to modulate totalpower to the system.

The illustrative solar panel 710 provides electricity converted fromsolar energy to the charge circuit 712. The charge circuit 712 managescharging the battery 714 from the available solar energy and distributespower to the other hardware components. Additionally, the system mayoperate using an external non-solar power energy source.

The remote sensing device 720 may also incorporate a mechanical deviceor other such devices for changing the camera's field of view within alarger field of regard. Each motion or event detector 702 a, 722 and 702c or illuminator 708 a, 702 b, and 724 may be associated with a positionof the camera within this larger field of regard. A field of regardincludes the area covered by the sensor or detector when pointing to allmechanically possible positions. When a sense-event message such as thedetection message is received by the remote sensing device, the cameramay then adjust its field of view within the field of regard that isassociated with one of the motion or event detector 702 a, 722 and 702 cor illuminator 708 a, 702 b, and 724. This mechanism further extends thetotal field of coverage of the surveillance system substantially.

In the illustrative embodiments of the remote system presented herein, anetworked system includes one or more endpoints and a camera system withnode-capable viewing the desired field of regard. Each endpoint mayinclude a solar panel, solar charging system, internal battery,low-power wireless communications interface, microcontroller, daylightsensor, motion detection sensor such as PIR, or low-power illuminationmodule such as LED.

Referring to FIGS. 8A and 8B, there is shown an illustrative autonomousmethod for managing and controlling the remote sensing devices. Themethod is initiated at block 802 where the smartphone operating systemboot sequence is modified so that the operating system willautomatically start from a full unpowered state, i.e. battery deadstate, without requiring a user screen interaction. Alternatively, themicrocontroller turns on the smartphone. More specifically, smartphonesinclude a bootloader program that is responsible for starting theoperating system, as well as some peripherals such as the batterycharging system. The bootloader program is capable of detecting whenpower is applied to the phone via the USB port. Normally phones requirean external user input, e.g. press power button, in order to boot theoperating system. In the illustrative method presented herein, thebootloader program is modified so that a power input will start theoperating system at any time power is available, without any user input.

This automatic boot from poweroff is achieved as follows: When thedevice is fully powered off, pressing the power key or applying powervia the USB cable will trigger a section of code (called “u-boot”). Thiscode is part of the Android operating system framework adapted to aspecific phone. The u-boot code determines the reason for power up. Ifthe reason was the power key press, a normal Android boot is initiated.If the USB was the reason, the then operating system normally boots to a“charge only” mode. A modification to this “u-boot” code causes thephone to boot to Android no matter the reason for the power up (i.e., inboth USB-connect and button-press cases).

In some Android systems, a “power off” (via power button) does notcompletely power down the phone, but instead places Android into a lowpower state. In this case, the u-boot logic does not execute when thepower-button or USB input is triggered. Instead, a system-levelexecutable is in control of the phone. This system level executable alsoincludes logic for entering a “charge-only” state upon USB input. Thepresent invention also modifies the logic in this system-levelexecutable so that the USB input will boot Android, avoiding a “chargeonly” state.

The specific location and mechanism for the operating system/phone todecide whether to boot to Android or remain in a “charge only” state mayvary from specific phone hardware platform. However, the basic mechanismcan be found and one skilled in the art can see that that logic can besimilarly modified even in hardware platforms that partition the logicdifferently. For example, in an alternate embodiment, the smartphone maybe modified to connect the user power switch to the microcontroller, andthe microcontroller firmware may then control the user power switch toturn on the smartphone, thereby eliminating the need to modify thebootloader.

A second part of the present invention relating to automatic start ofthe application includes automatically launching the MNode applicationupon operating system reboot. This is achieved by the MNodeAppregistering to have itself launched when the Android“ACTION_BOOT_COMPLETED” intent is broadcast (when the Android bootprocess is complete).

The method then proceeds to block 804 where a software module isinstalled on the remote sensing device. More particularly, a remotesensing device software module or “application” is installed andexecuted on the smartphone. The remote sensing device software moduleprovides all required functions for operation as a presented herein.

The method then proceeds to block 806 where the remote sensing softwaremodule registers with the smartphone operating system in such a way thatthe remote sensing module will be automatically started anytime theoperating system is started.

At block 808, the method then proceed with the remote sensing softwaremodule initiating wireless communications by opening an illustrativebuilt-in cellular network communications channel, an illustrativebuilt-in Wi-Fi network communications channel, or other suchcommunications channel according to the configuration defined by thesmartphone and the remote sensing software module.

In operation, the MNode is configured by an end user or manufacturer toutilize either a Wi-Fi or cellular network. This is achieved by the userconnecting to the system via USB2 or Bluetooth. This interface allowsthe user to select the Wi-Fi or cellular interface, and to configure theinterface, e.g. enter Wi-Fi SSID/Passwords.

The method then proceeds to block 810 where the remote sensing softwaremodule is configured to automatically register the remote sensing devicewith the illustrative web application server over a Local Area Networkwith the illustrative Wi-Fi network communications channel.Additionally, the illustrative remote sensing software module isconfigured to automatically register the remote sensing device over aWide Area Network, such as the Internet, with the illustrative built-incellular communications channel. The registration process establishescommunications between the remote sensing software module and theselected web application server.

Upon deployment, the MNode uses the designated network to communicate tothe web application server which is running at a fixed IP address. Thisallows the MNode to become part of the monitoring network without havinga fixed IP address, and this ability to operate without the MNode fixedIP is critical to operating on a cellular network. This architecturealso has the additional advantage of not requiring any firewall orrouter configuration modifications in order for the MNode to operate onLANs that have a firewall/router between the LAN on the Internet.

Once registered with the WebApp Server, the MNode requests aconfiguration to be downloaded that includes the program parameters forthe MNodeApp including: when to trigger pictures, when to upload data,how often or under what conditions to log data, which events to notifyuser, etc.

At block 812, the remote sensing software module requests aconfiguration from the web application server, which controls theoperation of the remote sensing software module including logging ofdata and images, alerts and notifications, and periodic upload of datato at least one web application server.

One illustrative programmable parameter of the MNode includes the“heartbeat” period, which is the length of time the MNode will wait tocontact the WebApp server again. Since the MNode is not required to havea fixed IP address, the architecture is that the MNode contacts theWebApp server in order for any communications to take place.

The heartbeat is a programmable schedule at which the MNode contacts theWebApp server in order to receive messages pending from the WebAppserver, and to upload any data pending to be uploaded from MNode toserver. In typical remote sensing systems, the server contacts theremote nodes to establish communications. The heartbeat architecture ofthe present invention provides several advantages over prior artincluding: (a) does not require remote node to have fixed IP address orany other fixed address, (b) simplifies the WebApp server in not havingto maintain list of active devices until those devices first contact theWebApp, (c) provides enhanced security from denial of service and othernetwork level attacks on the remote node.

The heartbeat schedule in the MNode is programmable, and includes two“levels” of communications frequency. A first frequency (“shortheartbeat”) is a higher frequency of communications and is used once theMNode contacts the WebApp server and finds a message pending. This shortheartbeat is used until a timeout period has been reached (“heartbeattimeout”), at which time the MNode reverts to a second longer heartbeatfrequency (“long heartbeat”). This scheme allows a beneficial tradeoffbetween system responsiveness and power consumption; the long heartbeatallows lower system duty cycles, while the short heartbeat allowsresponsive user interaction with the system. In an alternativeembodiment, these heartbeats may be modified dynamically based on timeof day, user interaction, or other factors, in order to further optimizethe tradeoff between power consumption and system responsiveness.

Another known problem with distributed and networked systems includes“registering” the device with the server or other nodes, so that thatnew device becomes known to the system. This registration may alsoinclude initialization procedures and data that may be required for thenew remote node to properly operate as part of the network.Traditionally, this is performed by an external process for the serverto know about the node, such as entering a serial number or networkaddress. In the present invention, the “reverse” communicationsarchitecture along with the “heartbeat” mechanism, are used to simplifythe provisioning. An MNode coming from the factory, or from a virginstate, transitions to an active state by sensing a power input (or othermeans). Once in this active state, the MNode will use the heartbeatmechanism described above to contact the server. If this is the firsttime the MNode has contacted the web application server, a “provisioningprocess” is triggered, whereby the web application server provisionsthat device into the network and thereby enables subsequentcommunications and management of the node by the web application server.This method of automated provisioning simplifies the process and removesthe burden from the user of configuring a node into the network.

Once the web application server initiates the provisioning process withthe newly discovered MNode, additional provisioning steps can easily beincluded such as updating the MNode with the latest firmware revisions,and configuring the device to the proper initial state.

The method then proceeds to block 814 where the remote sensing softwaremodule disposed on the smartphone, controller, or the combinationthereof determines whether to enter a “hibernate” mode or state. In thehibernate state, the smartphone phone shuts itself off and theillustrative controller firmware module removes power input from thesmartphone. The hibernate mode includes an extreme low power state thatcan be entered and exited via user input from the USB2. By way ofexample and not of limitation, the hibernate mode is used to ship theunit from the factory to the user so that battery is not significantlydischarged during this transition when no power input is available.

By way of example and not of limitation, the microcontroller issues a“reboot-p” command to the phone via the ADB shell connection; thispowers off the smartphone. The microprocessor then cuts power to thesmartphone and then enters sleep mode itself, but ensures that the USARTstays active. For example, every eight seconds the smartphone wakes upvia a watchdog alarm and checks the serial port for the wakeup command,and checks if power was applied, also triggering a wakeup. When theappropriate instruction is received, the microprocessor restores powerto the phone. By way of example and not of limitation, a “Boot toAndroid” firmware mode may be installed in the phone, which causes thephone to boot up and start running the illustrative MNodeApp.Alternatively, the microcontroller controls the phone power switch inorder to boot the phone and start the MNodeApp. Subsequently, themicroprocessor resumes normal operations.

The method then proceeds to decision diamond 816, where a decision ismade regarding thermal management. More specifically, remotebattery/solar powered camera/monitoring systems may need to provideheating in order to maintain internal electronics above minimumoperating temperatures in the face of lower external ambienttemperatures. Heating can represent a significant power requirement forsolar/battery powered systems in colder climates. A “thermal battery”technique is used to minimize overall energy consumption whilemaintaining the required minimum operating temperatures for internalelectronics. The remote sensing device includes a method of thermalmanagement that takes advantage of the diurnal cycle and utilizes athermally insulated electronics enclosure to store thermal energy duringperiods when solar charging power is more abundant. This stored thermalenergy enables maintenance of the internal electronics above minimumoperating temperature at a lower overall system energy consumption thanwould otherwise be possible.

The illustrative algorithm for thermal management uses the internalelectronics to measure input power from the solar charging system, thecurrent battery states, the outside ambient temperature, and weatherforecast. If the forecast calls for outside ambient temperaturessignificantly below the minimum operating temperature of theelectronics, and the solar charging system is providing excess powerabove what is needed to maintain the batteries at desired operatinglevels, then the thermal management algorithm will “divert” some of thisinput electricity to the heating system. The heating system will therebybring the internal temperature above the minimum operating temperature,even up to the maximum operating temperature of the electronics.

With this thermal management method, on days where a “cold night” iscoming, any excess solar power input is converted to thermal energy and“stored” in the enclosure/electronics by virtue of the insulatedenclosure. The system can be further enhanced by increasing the overallthermal mass of the system by including in the enclosure design,significant mass of metal, or other thermally conductive material, tofurther “store” the thermal energy.

As the diurnal cycle progresses and the ambient external temperaturedrops, the system will have reduced need to provide heating of theelectronics due to thermal mass of the system. This reduces the overallpower requirement for the system (batteries, solar panel capacity).

The illustrative thermal management system may be further enhanced byusing an electrically-based cooling system (such as a peltier device) tomaintain internal electronics below maximum operating temperatures. Inthis case, the maximum cooling requirement will coincide with thedaytime and maximum solar capture period. However, the algorithm can bemodified in this case to use any excess solar input power to cool thesystem below the required maximum upper temperature, and store thenegative thermal energy to provide “carry over” cooling during periodswhen there is no excess solar input energy.

The method then proceeds to decision diamond 818, where a determinationof frequency logging is made based on bandwidth and power consumption. Akey parameter in a remote telemetry system is the utilization of bothpower and bandwidth for communications. Many aspects, such as the datalogging frequency, are user-programmable and include a software functionfor providing automated bandwidth and power estimation in order to guideuser expectations and programming of the system.

In the illustrative embodiment, the bandwidth estimator includes aprogrammable upload parameter. This parameter determines how oftenlogged data is uploaded to the server. The system also includesuser-programmable data logging statements. The data logging statementsinclude the type of data to be logged (e.g., analog value, image) andthe frequency of logging. The bandwidth estimator first calculates theamount of data that is expected to be logged during a given bandwidthusage period (e.g., month). The bandwidth estimator then inspects thecurrently programmed upload frequency. These values are combined toprovide an estimate of the network bandwidth required during a givenbandwidth usage period.

Some data logging can be programmed to occur based on external events(e.g., capture image when there is motion detected). In this case, thebandwidth estimator uses a fixed background frequency for that type ofevent (X times per day). This estimate then generates an expected amountof event-driven logged data that can be added to the scheduled dataestimate.

The normal operation of the device is to remain in “sleep” mode unlessthere is an event-driven action (e.g., data logging) or aschedule-driven event (e.g., logged data). Power consumption in sleepmode is significantly less than when the unit is awake to process anevent. The power estimator also operates on the scheduled andevent-driven program settings of the device. Each scheduled orevent-driven program is assigned a “processing time” required to takethat action. For example, the time to wake up, take and store an image,go back to sleep. The power consumption of the device during thisoperation is known to the system for both sleep and “processing” states.There may be different power consumption values for different processingstates (e.g., taking picture vs. logging data value). The total timerequired for all programmed and event-driven actions is compared to agiven time period (e.g., per hour) to determine a “duty cycle.” Thisduty cycle represents the percent of time the system spends at each“power consumption level.” Thus, the total power consumption isestimated for the given programmed regime.

The method then proceeds to decision diamond 820 where the alarmverification process is initiated. Alarm verification refers to theprocess of having an alarm associated with a first sensor, e.g. motiondetector, triggered by having detected a particular event, e.g. motion,and then proceeds to “verify” the event by using another sensor, e.g. acamera, to take a picture at the same time that the alarm was triggered.The illustrative example of alarm verification in a perimeter securitysystem provides automatic alarm verification without requiring usercommunication or network traffic. More specifically, the MNode may beconfigured to have at least one “perimeter intrusion sensors,” such aspassive infrared (PIR), infrared (IR) beams, fence-line vibrationsensors, or other sensor that is capable of detection an event ofinterest such as heat, motion, or sound.

More generally, event evaluation is performed at decision diamond 822.Events are conditions that are periodically evaluated and result inaction or alert. An action refers to starting or stopping a process. Analert refers to a notification that is sent to a particular user, groupor autonomous monitoring entity. Event evaluation entails reading themost current sensor values, looking at programmed event/alarmspecifications, determining the true events and/or alarms associatedtherewith and taking the prescribed actions. In this illustrativeembodiment, the alarm verification is a species or type of the moregeneral event evaluation process.

For example, when the MNode receives the signal over the wireless sensornetwork from any of the attached perimeter intrusion sensors, itautomatically collects one or more images or video clips of the regioncovered by the intrusion sensor. The illustrative collected images areconfigured to be processed by the MNode software application to detectvisual objects of interest, e.g. human or vehicle. The MNode softwareapplication may use any of a number of known algorithms for video motiondetection, object detection, or other visual event detection, by meansof the powerful phone processor, in order to carry out this visualdetection onboard the phone. A positive detection results in a confirmed“alarm” that is then communicated to the user as an intrusion alarm. Alack of detection indicates that the intrusion sensor provided a falsealarm.

Typical intrusion sensors, such as PIR, often have very high “falsealarm” rates, i.e. a signal when there is no event of interest. Thismethod of automatic visual alarm verification or event evaluationreduces the false alarms that the system user sees. By performing theprocessing for this event evaluation or alarm verification on the MNode,the process also reduces network traffic by avoiding sending of alarmsor images that have not been verified.

Referring now to FIG. 9A, there is shown a perspective view of anillustrative enclosure. In FIG. 9B there is shown a top view of theillustrative enclosure. The illustrative enclosure 902 is configured toreceive a smartphone 904 that is electrically coupled to a smartphoneconnection 906. A microcontroller 908 is proximate to the smartphone 904and two auxiliary batteries 910. The enclosure also includes a firstconnector 912 for power input from an illustrative solar panel.Additionally, the enclosure includes a second connector 914 thatprovides a USB for a hardwire connection to the microcontroller 908.

The auxiliary battery 910 is electrically coupled to the powermanagement module and illustrative solar panels (not shown). The solarpanels charge the auxiliary battery 910, which then charges the batteryin smartphone 904.

The enclosure 902 also houses the thermistor, cooler, and heaterelements. This enclosure seals these components from the environment andprovides an appropriate thermal environment which can be temperaturecontrolled to maintain internal temperatures within allowable range inthe face of ambient temperature fluctuations. The enclosure 902 isfabricated from materials that do not attenuate RF signals in the bandsused by cellular, Wi-Fi, Bluetooth, NFC, and wireless sensor networks.

Additionally, the enclosure 902 incorporates one or more opticallytransparent windows 916. The smartphone 904 is mounted in the enclosure902 such that the field of view 918 passes through the enclosure window916.

An additional optional camera or other such sensor may be mounted in thesame enclosure or a separate enclosure 902. The optional camera orsensor communicates with the smartphone via wireless (Wi-Fi, Bluetooth)or USB. The illustrative sensor includes a wireless thermal infrared(TIR) or a passive infrared (PIR) sensor that can also be combined witha remote wireless illumination node. The illumination node can bepowered by a battery, a solar panel, or the combination thereof, asdescribed herein. The illumination node is a low power node thatilluminates the vicinity surrounding the node location.

Referring to FIG. 10, there is shown a screenshot for an illustrativedashboard that logs data for the remote sensing system described above.The dashboard 1000 includes an image or video 1002 captured by a cameraassociated with the remote sensing device. In addition to the location1004 of the remote sensing device being provided, the dashboard 1000also includes power information 1006, device and network information1008. Additionally, various system alarms 1010 are presented on theright hand side of the user interface. At the bottom of the page, achronological data log 1012 is provided that includes variousannotations and recordings.

The illustrative remote sensing device, system, and method described asmartphone programmed for remote operation that is housed in anenvironmentally controlled housing. The illustrative smartphone includesa microprocessor, non-volatile storage, an integrated camera, anintegrated and/or modular battery, and at least one wired or wirelessinterfaces such as a point-to-point interface, LAN interface, a WANinterface, or any combination thereof.

Additionally, the remote sensors may be connected via the wired orwireless interfaces. Illustrative remote sensors include transducers andsmart sensors. These remote sensors may provide input or output ofanalog or discrete values via connected transducers, switches, relays,and other such communication paths.

The remote sensing system also optionally includes one or more batteriesthat are housed in the environmentally controlled housing. An optionalinput for external power (from a mains, or solar panel or other source)is managed by a battery charging circuit which recharges both the phoneand any auxiliary batteries to maintain charge levels from externalpower inputs.

In yet another illustrative embodiment, the remote sensing systemincludes a networked system comprising one or more endpoints and acamera system node capable viewing the desired field of regard. Theendpoints each comprise a solar panel, solar charging system, internalbattery, low-power wireless communications interface, microcontroller,daylight sensor, motion detection sensor (such as PIR), and a low-powerillumination module, such as LED.

For example, the endpoint collects power from the solar panel and storesit in the battery. The battery provides power to the other systemelements. The motion-detection sensor signals the microprocessor whenmotion is detected. Upon motion detection, the microprocessor sends amessage over the low-power wireless communications interface to thecamera system. Upon receiving the message, the camera initiates an imagecapture of either still images or video sequence. If the endpoint'sdaylight sensor indicates that it is dark, then the endpoint illuminatesits area using the illumination module so that the camera captures anilluminate image.

In a further illustrative embodiment, the remote sensing system includesa camera system node that includes a low-power wireless communicationsinterface enabling communication between the camera and the endpoints.The camera system may comprise a fixed camera or a moveable camera(pan-tilt zoom).

Additionally, an illustrative remote sensing method is embodied in aremote sensing application that communicates with the associatedsensors/cameras of the remote sensing system. The illustrative softwareapplication may be configured based on the presence of, and/or sensedvalues from, the attached sensors. The illustrative software applicationand method handles the reading of the attached sensors/cameras, storageand timestamp of captured data, local data processing based onprogrammed configuration, issuing alarms to remote users per theconfiguration, uploading captured data to remote site per the programmedconfiguration, and controlling sensors per the remote commands orprogrammed configuration.

An illustrative apparatus is also described that includes a smartphonehoused in an environmentally controlled housing that includes at leastone sensor for detecting internal temperature of the enclosed phone andelectronics, a cooling device for cooling the internal enclosure andelectronics (e.g. as a Peltier cooler), a heating device for heating theinternal enclosure and electronics (e.g. as a Peltier or resistiveheater), a comparator circuit for comparing sensed temperature to storeddesired min/max temperature ranges, and controlling heater/coolerdevices to maintain an internal temperature within required ranges.

The remote sensing system described above satisfies a plurality of keyrequirements that enables remote sensing system to support a variety ofdifferent features. The feature may be deployed at a low cost, consumelow power, and have ability to support the local storage of data,operate on familiar software development platforms, provide multiplesmodes of communication, support an integrated data framework, andsupport user mobility.

Low cost is a key requirement because a given application may requirehundreds or thousands of remote monitoring sites to implement anapplication. Total system cost—including hardware, software development,communications, installation, and maintenance—are critical to theapplicability of the solution.

Low power is also a key requirement. Power supplies—including solar,batteries, and cabling—all grow the size, weight, and cost as a functionof the power requirements of the device.

Another key requirement for remote sensing is the ability to providelocal processing of data, because remote communications may beintermittent, have variable latencies, and incur communications costs.Some remote monitoring and/or control applications require data to belogged or acted upon within a fixed interval of time. Therefore, thereis a requirement that the remote sensing system have the ability toperform some processing of the 10 data independent of any wide areacommunications or other system elements. Local processing of data alsoallows the sensing node to act based in sensed values, for example, onlyrecord images when motion sensor is triggered. Visual alarm verificationonboard the smartphone can significantly reduce mobile communicationscosts, providing a significant commercial advantage.

An ability to provide local storage of data is another requirement forremote sensing. Remote communications to the sensing system may beintermittent. To ensure continuous monitoring and collection of data itis necessary for the remote sensing system to have local storage ofdata. Since a remote sensing system may collect many channels of dataover long periods of time, it is beneficial to have a substantial amountof local storage capability.

Yet another requirement for remote sensing is a simple, flexible,well-known software development platform because some applicationsrequire specific logic to operate on the remote sensing device toimplement the required data collection, control, or alarming functions.In order to facilitate development of this logic at the lowest cost, itwould be beneficial to support a remote sensing platform that utilizes awidely available software platform for development and deployment ofapplications.

Multiple modes of communication are another requirement for remotesensing. In order to provide communications of data from the remote siteto the user or central operations, and in order to provide remotecontrol of devices managed by the remote sensing system, acommunications capability is required as part of the remote sensingsystem. For reliability, and ease of deployment it would be beneficialto provide multiple modes of communication supported (e.g., Wi-Fi,Cellular, Satellite). Wireless communications are strongly preferredover wired in order to achieve simplicity and low cost installation andmaintenance.

A further remote sensing requirement includes integrated analog,digital, and image and video data. Modern applications require bothanalog and digital 10 capabilities, as well as still and video data. Toachieve the goals of simplicity and low cost, it is necessary to have asingle integrated platform that can support the 10 and processing ofanalog, digital 10, as well as video and still imagery.

Furthermore, mobility is another requirement of remote sensing becausesome applications (e.g. transportation) require remote sensing system tomove with the device (vehicle) or environment being sensed. It wouldtherefore be beneficial for the remote sensing system to be capable ofbeing used in fixed applications, mobile applications, or anycombination thereof.

It is to be understood that the detailed description of illustrativeembodiments are provided for illustrative purposes. The scope of theclaims is not limited to these specific embodiments or examples.Therefore, various elements, details, execution of any methods, and usescan differ from those just described, or be expanded on or implementedusing technologies not yet commercially viable, and yet still be withinthe inventive concepts of the present disclosure. The scope of theinvention is determined by the following claims and their legalequivalents.

What is claimed:
 1. A remote sensing device comprising, an enclosure; asmartphone disposed within the enclosure, wherein the smartphone isfixedly coupled to the enclosure; and a separate microcontrollerdisposed within the enclosure, the separate microcontrollercommunicatively coupled to the smartphone, the separate microcontrollerincluding: a power management module electrically coupled to anauxiliary battery that powers the smartphone, and a microcontrollerprocessor communicatively coupled to the smartphone, the microcontrollerprocessor controls the power management module.
 2. The remote sensingdevice of claim 1, the smartphone including: a smartphone processor; asmartphone memory communicatively coupled to the processor; a smartphonecamera communicatively coupled to the smartphone processor and thesmartphone memory; a first smartphone wireless communication interfacethat communicates with a wide area network; and a smartphone batteryelectrically coupled to the smartphone processor the smartphone memory,the smartphone camera, the first smartphone communication interface. 3.The remote sensing device of claim 1, further comprising: a temperaturesensor within the enclosure; a cooling component within the enclosurefor cooling the smartphone housed by the enclosure, when the temperaturerises above a first threshold temperature that is measured by thetemperature sensor; and a heating component within the enclosure forheating the smartphone housed by the enclosure, when the temperaturefalls below a second threshold temperature that is measured by thetemperature sensor.
 4. The remote sensing device of claim 1, wherein theenclosure seals the smartphone and the separate microcontroller toprotect the smartphone and separate microcontroller from environmentalconditions.
 5. The remote sensing device of claim 1, further comprisingat least one solar panel coupled to the auxiliary battery.
 6. The remotesensing device of claim 5, wherein the at least one solar panel chargesthe auxiliary battery.
 7. The remote sensing device of claim 1, furthercomprising at least one sensor communicatively coupled to the smartphonethat communicates a sensor signal output and a corresponding timestampto a wide area network.
 8. The remote sensing device of claim 1 whereinthe separate microcontroller further comprises a wireless sensor networkmodule; and a sensor that further includes a sensor wirelesscommunication module that is communicatively coupled to the wirelesssensor network module.
 9. The remote sensing device of claim 1, furthercomprising: a motion detection sensor; and an illumination node thatsignals when motion is detected and then triggers a camera included inthe smartphone to capture at least one image.
 10. The remote sensingdevice of claim 1, further comprising a separate camera communicativelycoupled to the smartphone.
 11. A remote sensing system comprising: anenclosure; a smartphone disposed within the enclosure, wherein thesmartphone is fixedly coupled to the enclosure; a separatemicrocontroller disposed within the enclosure, the separatemicrocontroller communicatively coupled to the smartphone, the separatemicrocontroller including: a power management module electricallycoupled to an auxiliary battery that powers the smartphone, and amicrocontroller processor communicatively coupled to the smartphone, themicrocontroller processor controls the power management module; a webapplication server communicatively coupled to the wide area network, theweb application server receives a sensor signal output and correspondingtimestamp from the smartphone; and a database communicatively coupled tothe web application server, wherein the database logs the sensor signaloutput and timestamp communicated by the smartphone.
 12. The remotesensing system of claim 11, the smartphone further comprising: asmartphone processor, a smartphone memory communicatively coupled to thesmartphone processor, a smartphone camera communicatively coupled to thesmartphone processor and the smartphone memory, a first smartphonewireless communication interface that communicates with a wide areanetwork, a smartphone battery electrically coupled to the smartphoneprocessor the smartphone memory, the smartphone camera, the firstsmartphone communication interface; and


13. The remote sensing system of claim 11, further comprising: atemperature sensor within the enclosure; a cooling component within theenclosure for cooling the smartphone housed by the enclosure, when thetemperature rises above a first threshold temperature that is measuredby the temperature sensor; and a heating component within the enclosurefor heating the smartphone housed by the enclosure, when the temperaturefalls below a second threshold temperature that is measured by thetemperature sensor.
 14. The remote sensing system of claim 11, whereinthe enclosure seals the smartphone and the separate microcontroller toprotect the smartphone and separate microcontroller from environmentalconditions.
 15. The remote sensing system of claim 11, furthercomprising at least one solar panel coupled to the auxiliary battery.16. The remote sensing system of claim 15, wherein the at least onesolar panel charges the auxiliary battery.
 17. The remote sensing systemof claim 11, further comprising at least one sensor communicativelycoupled to the smartphone that communicates a sensor signal output and acorresponding timestamp to a wide area network.
 18. The remote sensingsystem of claim 11 wherein the separate microcontroller furthercomprises a wireless sensor network module; and a sensor that furtherincludes a sensor wireless communication module that is communicativelycoupled to the wireless sensor network module.
 19. The remote sensingsystem of claim 11, further comprising: a motion detection sensor; andan illumination node that signals when motion is detected and thentriggers a camera included in the smartphone to capture at least oneimage.
 20. The remote sensing system of claim 11, further comprising aseparate camera communicatively coupled to the smartphone.